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FOREWORD 


This  report  presents  a new  cost  forecasting  method 
developing  independent  estimates  at  completion  (E'^Cs)  by 
utilizing  data  available  in  the  Cost  Performance  Reports 
( CPRs ) . 

The  fact  that  many  tools  and  data  sources  are  i;ed 
for  cost  forecasting  suggests  that  forecasting  inhe.ently 
contains  some  degree  of  subjectivity.  This  model  provides 
the  analyst  with  a method  for  including  subjective  aoju;t- 
ment  based  on  prior  expedience  when  developing  an 
Evaluation  of  any  method  requires  that  it  be  repea  see  1 y 
tested  under  realistic  conditions.  Although  the  Aero- 
nautical Systems  Division  is  in  the  process  of  accumulating 
a large  body  of  test  data  that  can  be  useful  in  implementing 
and  improving  this  method,  time  limitations  dictate  that 
the  principles  of  its  operation  be  described  to  the  finan- 
cial analysis  community  as  an  initial  step  in  its  evolution- 
ary development. 

The  author  expresses  his  appreciation  to  many 
individuals,  Program  Offices,  and  the  Comptroller  at  ASD 
for  their  cooperation  and  encouragement  in  pursuit  of  this 
research  task,  particularly,  Mr.  Douglas  Tussing  (a  former 
member  of  the  B-l  office)  and  Mr.  John  Grace  of  the  Computer 
Science  Center  (4950/ADDP). 


ABSTRACT 


This  reoort  -identifies  and  illustrates  the  princi- 
ples of  a r.ew  and  potentially  valuable  cost  forecasting 
method.  It.  i*  the  objective  o.'  the  technique  to  forecast 
Estimates  At  Completion  (EACs)  each  month,  utilizing  data 
available  in  the  Cost  Performance  Reports  (CPRs). 

A single  sample  was  used  as  a uniform  data  base  for 
comparing  the  consequences  of  various  methods.  These 
i.,ethods  are  the  linear  extrapolation  cf  percent  cumulative- 
cost  variance  and  unconstrained  and  constrained  regression 
analysis  applied  to  an  exponential  relationship.  The 
sample  data,  computed  data,  computational  procedures,  and 
resource  references  are  contained  in  the  report  to  permit 
reproduction  of  simila;  vsults. 

The  report  shows  that  the  constrained  regression 
method  aoplied  to  an  exponential  relationship  offers  the 
forecarfe;  an  improved  method  of  final  cost  forecasting 
and  introduces  the  use  of  measured  subjectivity  as  a 
management  input. 
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1 -°  INTRODUCTION: 

The  primary  objective  of  any  forecasting  method  is 
to  predict  the  true  outcome  of  an  event.  Predicting  a 
true  outcome  is  more  often  a desired  goal  rather  than 
an  achievement.  However,  such  a goal  serves  as  a 
motivating  force  for  stimulating  the  creative  aspirations 
of  many  analysts  . 

This  report  describes  and  compares  three  EAC  fore- 
casting methods  on  the  basis  of  the  data  contained  in  the 
Cost  Performance  Reports  (CPRs)  and  within  the  scope  of 
the  Cos c/Schedul e Control  Systems  Criteria.  Although 
the  CPR  contains  data  that  reflects  the  consequences  of 
many  influences,  it  is  a measure  of  past  performance.  In 
contrast,  forecasting  deals  with  future  time  periods  and 
their  corresponding  influences.  Each  of  the  methods  treat 
the  CPR  data  in  different  ways  in  order  to  account  for 
the  influences  in  future  time  periods. 

It  is  not  the  intent  of  this  report  to  evaluate  the 
data  contents  of  the  CPR  other  than  to  utilize  certain  of 
the  elements  within  the  report.  The  description  of  the 
data  base,  forecasting  methods,  assumptions,  and  graphical 
illustrations  of  the  EAC  forecasts  are  contained  in  the 
body  of  the  report.  The  source  data  and  computed  results 
are  contained  in  the  Appendix  for  reference. 


2.0  THE  DATA  BASE: 


Although  a variety  of  R&D  program  results  are 
available  for  analysis  and  would  have  contributed  to  a 
more  complete  presentation,  limited  resources  precluded 
their  inclusion  in  this  report.  The  more  important 
priority  was  the  need  to  communicate  the  principles  of 
a new  method.  Therefore,  a single  sample  of  CPR  data 
was  chosen  as  the  data  base  for  comparing  various  methods. 
Table  1 and  part  of  Table  2 in  the  Appendix  contains  the 
transcribed  data  sample  of  a completed  program.  Table  1 
includes  the  monthly  cumulative  values  of  Actual  Cost  of 
Work  Performed  (ACWP),  Budgeted  Cost  of  Work  Performed 
(BCWPj,  and  Budget  At  Completion  (BAC).  The  contractors 
monthly  Estimate  at  Completion  (EAC)  was  recorded  in 
Table  2 to  permit  a direct  comparison  with  the  EACs 
computed  from  the  three  methods  described  in  this  report. 

The  sample  was  selected  on  the  following  basis. 

a.  The  program  was  completed.  This  pre- 
requisite was  believed  necessary  in  order  to  insure  that 
all  the  ACWPs  were  included  in  the  sample  even  though  it 
was  observed  that  BCWP  had  summed  to  BAC  prior  to  the  last 
submittal  of  the  CPR. 

b.  Some  engineering  changes  occurred  during  the 
life  of  the  program.  It  is  typical  rather  than  the 
exception  to  expect  engineering  changes. 
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c.  A modest  increment  of  additional  work  was 
added  to  the  program.  Modest  additions  of  new  work  is 
reasonable  to  expect  in  R&D  programs  in  order  to  take 
advantage  of  technological  improvements  and  adjust  for 
changing  requ i remen ts , especially  if  t1'?  program  is 
planned  for  several  years. 

d.  The  program  was  effected  by  cost  escalation. 
Many  programs  that  extend  for  several  years  have  experienced 
the  effects  of  cost  escalation. 

There  was  no  attempt  to  pre-select  the  sample  on  the 
basis  that  it  could  prove  or  disprove  any  method.  The 
solutions  associated  with  this  sample  were  not  available 
to  the  author  at  the  time  of  sample  selection. 
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3.0  DESCRIPTION  AND  COMPARISON  OF  METHODS: 


3 . 1 COMPAR ISON  FRAMEWORK 

A comparison  of  three  independent  methods  of 
forecasting  is  described  and  illustrated  in  this  report. 

The  three  methods  are  identified  as  the  "Cumulative 
Current  Percent  Cost  Variance",  the  "Unconstrained 
Exponential",  and  the  "Constrained  Exponential", 
respectively.  The  monthly  EAC  dollar  forecasts  for  each 
method  are  graphically  related  to  each  month  of  the  60 
month  program  in  Figures  1 arid  4.  In  addition,  the  % 
completion  is  superimposed  on  the  linear 

monthly  scales  so  that  each  forecast  may  be  examined 
with  respect  to  time. 

It  is  also  noted  that: 

The  monthly  BAC  is  included  in  the  same 
manner  as  the  forecasted  EACs.  The  monthly  BAC  may  be 
viewed  as  another  EAC  method  since  it  is  related  to  a 
contractual  definition  of  program  cost. 

The  final  ACWP,  which  is  obtained  after 
the  last  CPR  publication,  is  the  reference  point  for 
judging  the  relative  merits  of  the  forecasting  methods 
for  each  monthly  forecast. 

Table  2,  in  the  Appendix,  contains  a summary  of 
all  the  data  used  ir  the  comparison  of  EAC  methods.  Due 
to  the  volume  of  data  being  compared,  the  description  of  the 
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methods  and  their  comparisons  are  divided  into  two  parts 
for  ease  of  ai scussi on . 

In  the  first  part  (paragraph  3.2),  EACs  generated 
by  applying  the  "Cum.  Current  % Cost  Variance  Method"  are 
described  and  compared  to  the  results  obtained  by  the 
"Unconstrained  Exponential  Method"  and  illustrated  in 
Figure  I.  In  che  second  part  (paragraph  3.3),  t'ACs  generated 
by  applying  the  "Constrained  Exponential  Method'1  are 
described  and  added  to  the  illustration  of  the  first  part 
(Figure  1)  so  *hat  all  three  methods  may  be  examined 
simultaneously  in  Figure  4. 


3.2  COMPARISON  OF  TWO  EAC  METHODS: 


3.2.1  DESCRIPTION  OF  THE  CUM.  CURRENT  % COST 
VARIANCE  METHOD: 

This  method  of  computing  an  EAC  is  based  upon 
the  assumption  that  in  each  month  the  computed  cumulative 
% cost  variance  X 100)  may  be  linearly  extrap- 

olated to  the  end  of  the  program  as  a measure  of  the  final 
outcome.  It  assumes  that  an  increment  of  ACWP  dollars 
(overrun  or  underrun)  at  the  end  of  the  program  applied 
to  the  current  BAC  entirely  depends  upon  the  current  status 
reported  in  the  CPR  without  regard  to  its  proximity  to  the 
end  point.  Identical  results  may  be  obtained  by  applying 
the  Cumulative  Performance  Index  (CPI  = BCWP/ACWP)  to  the 
BAC  using  the  relationship,  EAC  = BAC/CPI.  This  relation- 
ship is  further  illustrated  in  the  AFSC  Guide  for  use  of 
Contractor  - Reported  Cost  Data,  dated  1 July  1972. 

Monthly  forecasts  of  EAC  were  generated  by  this 
method  in  chronological  sequence  without  regard  to  the 
data  in  previous  or  subsequent  CPRs.  Table  3 in  the 
Appendix  highlights  the  monthly  cumulative  % cost  variances 
and  the  resulting  EACs  throughout  the  entire  program. 

Figure  1 contains  a graphical  view  of  the  monthly  EACs  in 
dollars  on  the  ordinate  against  the  combined  scale  of  % 
completion  and  number  of  months.  Superimposed  on  Figure  1 
are  the  monthly  BACs  and  the  horizontal  trace  line 
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3.2.2  DESCRIPTION  OF  THE  UNCONSTRAINED  EXPONENTIAL  METHOD: 


3 - ? . 2 . 1 GENERAL  CONSIDERATIONS 

This  method  makes  use  of  a least  squares  regression 
analysis  technique  for  developing  trend  characteristics. 

It  assumes  that  the  identification  of  a reasonable  trend 
relationship  of  an  ongoing  activity  will  set  the  pace  for 
future  activity.  Once  established  and  defined  it  may 
permit  extrapolating  to  the  ultimate  outcome. 

This  approach  inherently  requires  a balanced 
treatment  in  the  areas  of  data,  selection  of  behavioral 
relationships  and  a realistic  rationale.  The  research 
accomplished  to  date  examine  the  type  of  data  variables 
contained  in  this  sample  data,  (ACWP,  BCWP  & BAC).  It  is 
noted  that  Budgeted  Cost  of  Work  Scheduled  (BCWS)  has  been 
omitted.  Although  it  was  observed  that  the  continuous 
presence  of  schedule  variance  could  impact  the  final  ACWP 
it  was  believed  that: 

a.  The  treatment  of  schedule  variance 
required  a more  subtle  and  sophisticated  examination  than 
was  feasiole  within  the  scope  and  resources  of  this 
research  project. 

b.  The  selection  of  a reasonable  behavioral 
relationship  between  ACWP  and  BCWP  may  be  sufficient  to 
account  for  the  impact  that  BCWS  has  on  EAC  without  the 
added  completity  of  another  variable. 
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3. 2. 2. 2 GROUND  RULES  AND  ASSUMPTIONS 


It  is  the  ideal  cost  objective  of  any  defined 
program  that  the  preplanned  budget  will  be  achieved. 

Before  action  is  taken  to  implement  the  plan,  it  is 
assumed  that  work  has  not  been  performed;  hence,  ACWP 
and  BCWP  are  both  equal  to  zero  since  they  are  both 
measures  of  work  performance.  After  initial  action  is 
taken  to  implement  the  plan,  the  output  of  human,  physical, 
and  financial  resources  are  periodically  measured  in  terms 
of  the  original  plan  at  various  levels  of  data  aggregation 
and  classification.  Although  the  ideal  objective  (Final 
ACWP  = Final  BCWP  = BAG)  represents  the  end  point  of  the 
total  effort,  it  would  be  ideal  if  cum.  ACWP  would  equal 
cum.  BCWP  at  each  measurement  period. 

Sketch  #1  illustrates  this 


arrangement.  It  is  observed 
that  a series  of  equal  and 
increasing  values  of  ACWP  & 

BCWP  produce  an  extended  45° 
straight  line  that  starts  at 
the  origin  and  ends  at  the 
BAC.  Above  the  line  represents 
the  area  of  cost  overrun  and 
below  the  line  the  area  of 
cost  underrun.  If  the  ACWPs 


SKETCH  #1 
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and  BCWPs  from  each  CPR  in  a given  program  were  to  locate 
on  the  45°  line,  it  would  evolve  a breakeven  line  that 
culminates  at  the  8AC  and  results  in  a series  of  zero 
current  cost  variances.  However,  a variety  of  reasons 
can  cause  differences  between  the  dollar  values  of 
ACWPs  and  BCWPs.  Therefore,  as  the  system  for  producing 
output  may  be  viewed  as  an  ongoing  or  continuous  process, 
the  actual  relationship  between  ACWP  and  BCWP  may  not 
appear  continuous  or  linear  with  each  passing  CPR.  The 
realization  of  a series  of  zero  variances  under  actual 
conditions  should  not  be  expected. 

In  a reporting  system  that  is  related  to 
controlled  work  performance,  it  is  anticipated  that  the 
performance  trend  may  have  a rational  and  continuous 
relationship.  From  a trend  of  view  the  following 
observations  are  made: 

As  work  is  being  performed 
and  new  worx  added  between 
leporting  periods,  an  increment 
of  BCWP  (equal  to  or  greater 
than  zero)  and  an  increment 
of  ACWP  (equal  to  or  greater 
than  zero)  should  appear  in 
the  subsequent  CPR  (see 
sketch  #2).  Each  new 
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increment  contributes  tc  the  new  cum.  totals  as  the 
process  is  repeated.  The  earlier  disparity  between 
cuin.  ACWP  and  cum.  BCWP  is  reduced  as  the  work  packages 
keep  flowing  through  the  productivity  process  and 
approaches  completion. 

The  ability  to  discern  any  trend  characteristics 
between  cum.  ACWP  ard  cum.  BCWP  requires  that  many  samples 
of  historical  CPR  data  be  examined  and  compared.  Unfortu- 
nately, the  large  amount  of  data  that  was  examined  coulu 
not  be  included  in  this  report.  The  R&D  data  samples 
included  cases  from  Level  1 , 2 & 3 of  the  Work  Breakdown 
Structure  (WBS)  and  several  functional  data  samples.  They 
encompassed  aircraft,  missile  and  electronic  systems. 
Although  samples  were  different  in  technology,  dollar 
amount,  element  type,  contractor,  and  cost  outcome,  these 
large  differences  narrowed  considerable  when  viewed  in 
terms  of  their  overall  growth  t 
the  predominant  behavior  of 
different  samples.  It  is 
observed  that  the  two 
curves  (1 ) & (2 ) appear 
near  parallel  even  though 
their  outcomes  are  dif- 
ferent. It  is  noted 
that  an  overrun  outcome 
is  not  a prerequisite  for 
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'"ends.  Sketch  #3  illustrates 


SKETCH  § 3 


this  shape  curve.  It  is  possible  that  another  curve 
containing  larger  amounts  of  earlier  underrun  cost 
variances  could  produce  a breakeven  or  underrun  result 
at  the  BAC  and  still  retain  a near  parallel  trend 
characterise c . A minority  of  samples  portrayed  a 
slightly  different  long  term  trend  characteristic. 


Sketch  #4  illustrates  two 
different  samples  in 
which  high  initial  cost 
overruns  are  gradually 
reduced  as  the  program 
nears  completion.  Again 
it  is  noted  that  curves, 
(1  ) & (2)  appear  near 
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Although  the  above  sketches  were  slightly 


■; ..  <vg  g e r a t e d for  illustration  purposes,  the  smooth  curves 
rep. esenti ng  the  data  examples  were  developed  by  utilizing 
a nor.  linear  least  squares  technique  and  the  assumed  rela- 
tionship, y - b-j.x^?.  This  relationship  was  selected  for 
its  desirable  properties  described  below: 

a.  In  most  samples  observed  a straight 
line  rel at icvshi p between  cum.  ACWPs  & BCWPs  did  not 
represent  the  long  term  growth  relationship.  Therefore, 
a curve  linear  form  was  considered  more  realistic. 
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b.  This  curve  linear  form  can  be  compared 
easily  to  the  ideal  case  (the  breakeven  line).  For 
example,  in  the  form  y = b^.x^,  it  may  be  observed  that 
when  b i and  b2  are  both  equal  to  one,  y equals  x,  and  the 
result  is  a 45°  straight  line  that  passes  through  the 
origin.  When  bp  is  greater  than  one,  it  suggests  that  y 
has  a tendency  to  grow  faster  than  x which  produces  a 
growth  curve  that  is  accelerating.  Conversely,  when  bp 
is  smaller  than  one,  it  suggests  that  y has  a tendency  to 
grow  slower  than  x which  produces  a growth  curve  that  is 
decel arati ng . 

c.  This  relationship  is  familiar  to  the 
financial  analysis  community  and  would  be  easy  to  handle 
by  the  user.  Although  there  are  other  potentially  useful 
curve  linear  growth  relationships  that  deserve  study,  they 
are  more  complex  in  their  mathematical  form  and  generally 
contain  more  than  two  parameters.  The  additional  parameters 
could  compound  the  complexity. 

d.  The  parameters  (b"|  & bp)  are  non- 
dimensional  and  they  represent  the  growth  characteristics 
of  a sample  rather  than  a dollar  value. 

In  summary,  if  a large  family  of  completed 
program  samples  are  similar  in  their  characteristics  and 
y = b-j.xbp  is  a reasonable  behavioral  relationship  then: 
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a.  One  may  use  the  relationship  to 
extrapolate  an  EAC  after  each  CPR  is  submitted  throughout 
the  program  life. 

b.  It  is  reasonable  to  expect  that  the 
computed  parameters  b-j  & b£  would  reflect  these 
similarities.  For  example,  the  variety  of  samples  examined 
illustrated  that  the  range  of  the  extreme  values  of  the 
exponent  (b2)  was  narrow  (1.18  - .97),  and  the  majority 

of  cases  between  1.10  and  1.0.  The  possible  use  of  this 
quantitative  information  is  illustrated  in  paragraph  3.3. 


3. 2. 2. 3 UNCONSTRAINED  PROCEDURE 


The  unconstrained  exponential  method  contained 

in  this  report  extrapolates  an  EAC  after  each  CPR 

submittal.  It  presumes  that  the  least  squares  technique, 

in  conjunction  with  the  cumulative  ACWTs  & BCWPs  from  each 

CPR  available  to  date,  the  current  BAC,  and  the  behavioral 

bo 

relationship  y = b - x . would  generate  a smooth  curve 
representing  the  cost  trend  of  the  program.  The  process 
is  accomplished  in  two  basic  steps  described  in  paragraph 
3.5. 

The  single  sample  defined  in  paragraph  2.0  is 
used  to  illustrate  the  process  and  application  of  the 
computer  program.  Table  4 in  the  Appendix  contains  a 
summary  of  results  of  this  method  including  the  value  of 
the  parameters  (b-]  & bg)  for  each  month  of  the  60  month 
period.  Table  5 and  Figure  2 in  the  Appendix  contains  the 
sample  computational  and  graphical  displays  of  the  computer 
program  at  the  end  of  the  60th  month.  Figure  1 contains  a 
graphical  view  of  the  monthly  EACs  in  dollars  on  the  ordinate 
against  the  combined  scale  of  % completion  and  number  of 
months  . 
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3. 2. 2. 4 THE  COMPARISON  OF  TWO  METHODS 

When  examining  the  variety  of  curves  illustrated 
or.  Figure  1,  the  reader  is  reminded  that  the  total 
illustration  exists  only  after  the  last  CPR  is  made  avail- 
able. At  any  intermediate  position,  the  right  hand  portions 
of  the  various  curves  do  not  exist  since  they  depend  upon 
subsequent  CPRs.  In  addition,  the  horizontal  solid  line 
representing  the  final  reported  ACWP  (97.9  dollars)  exists 
only  after  the  last  CPR  is  delivered.  The  following 
observations  are  made: 

a.  In  each  of  the  first  14  months  of  the 
program  the  data  sample  exhibited  a continuing  cumulative 
cost  underrun.  During  this  period  the  Cum.  Current  % Cost 
Variance  Method  forecasted  a series  of  EACs  consistently 
lower  than  the  relatively  uniform  BACs.  Considering  the 
fact  that  in  14  months  the  program  is  approximately  40% 
complete,  an  optimistic  view  of  this  series  suggests  a 
potential  cost  savings  at  the  end  of  the  program;  conversely, 
a pessimistic  view  suggests  a potential  breakeven  at 
program  completion.  The  Unconstrained  Exponential  Mecbod 
generated  underrun  EACs'  up  to  the  9th  month.  From  the 
9th  through  the  14th  montns  these  EACs  exceeded  the  BACs 
even  though  cum  current  variance  was  showing  underrun. 

This  occurred  because  the  amount  of  underrun  in  the  7th 
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month  was  significantly  reduced  and  subsequently  maintained 
for  two  more  months  at  a new  but  lower  underrun  level. 
Essentially,  the  Unconstrained  Exponential  Method  draws 
attention  to  the  trend  of  all  the  past  cum.  current  cost 
variances  and  shapes  the  curve  accordingly. 

After  the  14th  month  the  BAC  was  periodically 
adjusted  for  the  reasons  stated  in  paragraph  2.0  until  it 
leveled  at  about  45  months  and  99%  completion.  During 
this  period  of  time,  to  approximately  93%  completion,  the 
Unconstrained  Exponential  Method  EACs  had  a large  and  clear 
lead  over  the  Cum.  Current  Method  EACs  as  they  both  attempted 
to  target  in  on  the  Final  ACWP.  Between  93%  and  98% 
completion  the  two  methods  generated  near  equal  results. 

After  98%  completion,  the  Cum.  Current  Variance  Method  had 
a small  but  clear  lead  over  the  Unconstrained  Exponential 
Method  which  persisted  to  completion. 

To  select  one  method  over  another  requires  that 
a selection  criteria  be  defined.  A simple  selection 
criterion  was  defined  as  the  method  which  generates  EACs 
that  are  closest  to  the  final  ACWP  during  the  earlier 
stages  of  the  program,  and  the  Unconstrained  Method  proves 
best  after  the  7th  month.  This  criteria  offers  the  most 
direct  comparison  of  the  two  methods  used  in  their  entirety 
without  the  benefit  of  additional  information  that  may  have 
been  available  to  the  SPO  management. 
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3.3 


COMPARISON  OF  THREE  EAC  METHODS 


3.3.1  DESCRIPTION  OF  THE  CONSTRAINED  EXPONENTIAL 
METHOD 

The  notion  of  "Constrained"  and  "Unconstrained" 
is  described  as  follows: 

The  Unconstrained  Method  described  in 
paragraph  3.2.2  solves  for  the  parameters  (b]  & b2) 
without  the  benefit  or  intelligence  of  other  information 
dealing  with  growth  characteristics.  The  parameters 
derived  from  a few  early  samples  are  inadequate  "estimates" 
of  the  parameters  that  will  be  obtained  after  tho  entire 
population  becomes  available.  The  quality  of  the  parameters 
may  be  readily  examined  in  Table  4 by  observing  the  change 
in  the  parameters  as  each  CPR  is  added  to  the  sequence. 

As  a consequence,  caution  is  advised  when  attempting  to 
use  them  for  extrapolation  purposes  during  the  early 
stages  of  the  program. 

The  Constrained  Method  is  an  attempt  to 
overcome  the  deficiency  of  small  samples  by  superimposing 
an  intelligence  source  that  is  available  from  completed 
programs.  Selection  of  an  intelligence  source  introduces 
a high  degree  of  subjectivity  since  there  are  few  identical 
contractual  situations.  However,  it  is  reasoned  that  if 
the  data  associated  with  the  subjectivity  can  be  quantified, 
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the  range  of  results  narrow,  and  the  process  is  realistic, 
the  credibility  of  its  use  as  a forecasting  method  is 
improved  and  under  the  control  of  the  user. 

In  paragraph  3. 2. 2. 2 it  was  stated  that  many 
diverse  and  completed  samples  produced  sets  of  sets  of 
parameters  in  which  the  range  of  extremes  of  the  exponent 
(b2)  was  narrow.  This  phenomenon  suggest  the  possibility 
that  the  quantitative  values  of  the  historical  (b2)s  may 
be  used  as  the  subjective  device  for  superimposing  a single 
value  or  family  of  reasonable  values  on  an  ongoing  program 
in  which  the  sample  size  is  small.  In  effect,  the  user 
is  attempting  to  reduce  the  error  in  the  parameters  of 
small  samples  by  placing  the  sample  in  a historical  context. 
This  "constrains"  the  model  under  the  guidance  of  the 
manager.  A simple  demonstration  is  used  to  illustrate  the 
effects  of  the  constrained  method  on  forecasting  EAC. 


3,3.2  CONSTRAINING  PROCEDURE 


It  is  observed  that  in  Table  4 the  final 
exponent  for  the  given  sample  = 1.1175.  There  is  no 
way  of  knowing  the  precise  value  of  a final  exponent 
until  the  last  CPR  is  available.  However,  if  a body  of 
historical  parameters  for  similar  and  completed  programs 
suggest  a range  of  reasonable  values  or  a particular 
value,  those  values  could  be  used  as  a constraining 
influence  on  the  early  stages  of  the  new  program.  For 
demonstration  purposes  the  above  value  is  used  to  constrain 
the  solution  as  each  CPR  is  submitted  in  sequence  for  the 
given  sample. 

The  same  computer  program  referred  to  in 
paragraph  3. 2. 2. 3 performs  a similar  two  step  process. 

In  performing  the  process  for  the  Constrained  Method  the 
user  inputs  the  value  of  the  selected  parameter  (63  = 1.1175), 
and  the  computer  solves  for  the  remaining  parameter  (b-j) 
and  the  EACs  for  each  month. 

Table  6 in  the  Appendix  contains  a summary  of 
results  of  this  method  including  the  values  of  the  parameters 
for  each  month. 

Figure  3 in  the  Appendix  graphically  illustrates 
the  monthly  behavior  of  Ut  and  b„  for  the  Unconstrained 

1 C 

and  Constrained  Solution  Methods.  It  is  observed  that  a 
reasonable  estimate  of  a parameter  (b2  = 1.1175)  produces 
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3.3.3  THE  COMPARISON  OF  THREE  METHODS 


Figure  4 contains  all  the  information  in  Figure  1 
plus  the  results  of  the  Constrained  Method.  It  is  observed 
that  the  EACs  generated  by  the  Constrained  Exponential 
Method  are  considerably  higher  than  those  obtained  by  the 
other  methods,  and  are  consistently  closer  to  the  final 
ACWP  through  approximately  93%  of  program  completion. 

From  93%  to  98%  completion  all  three  methods  are  about 
equal  in  results.  Beyond  98%  completion  the  Cum.  Current 
Variance  Method  retains  a small  but  clear  lead  over  the 
remaining  methods. 

If  the  same  selection  criterion  defined  in 
paragraph  3. 2. 2. 4 is  used,  the  Constrained  Exponential 
Method  would  be  preferred  over  the  Unconstrained  Exponential 
and  Cum.  Current  % Cost  Variance  Methods.  As  a practical 
matter,  the  close  proximity  of  the  program  to  completion 
at  approximately  98%  suggests  that  the  Cum.  Current 
Variance  Method  should  reflect  the  final  position  since 
the  remaining  distance  is  minimal.  Figure  4 illustrates 
this  reality. 
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3.4  COMPARISON  OF  CONSTRAINED  & CONTRACTORS  EAC 


Frequently,  an  observer  is  interested  in  a comparison 
between  the  Constrained  Exponential  Method  and  the 
Contractors  reported  EACs.  For  examination  purposes 
this  comparison  is  illustrated  in  Figure  5.  It  is  observed 
that  the  Constrained  Exponential  Method  significantly  leads 
the  Contractor  EAC  through  approximately  90%  completion. 
Beyond  that  point  the  Constrained  Exponential  Method  lags 
the  Contractor  EAC  by  approximately  2 million  dollars  in 
each  succeeding  month.  After  99.5%  completion  the 
Contractor  EACs  exceeded  the  Final  reported  ACWP. 
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3.5  COMPUTER  PROGRAM  AND  OUTPUT  DISPLAYS 


An  overview  of  the  computational  process  is  described 
as  follows- 

STEP  1 : Given  the  sample  (each  monthly  cummed 

values  of  ACdP  and  BCWP  to  date)  and  the  function 
b ? 

ACWP  = b-|°jCw!P  , the  least  squares  technique  computes 
the  values  of  b^  & b2< 

STEP  2:  Given  the  computed  values  of  b-j  & b2 

from  Step  1,  the  current  value  o<;  &AC , the  function  final 
ACWP  = EAC  = b-|°BAC'J2,  the  value  of  1AC  is  computed. 

STEPS  1 &J2:  Steps  1 & l are  repeated  with  the 

arrival  of  each  subsequent  CPR  which  operates  a series 
of  monthly  EACs. 

The  process  described  in  the  above  st'.os  was  programmed 
at  ASD  on  the  CDC  6600  System  in  Fortran  Extended,  SCOPE 
3.4.  The  mass  of  manual  computations  involved  in  the 
process  would  preclude  the  timely  acquisition  and  evaluation 
of  results  by  financial  and  program  analysts.  The  computer 
program  produces  results  in  less  than  a day  and  can  be 
implemented  by  anyone  with  a minimum  knowledge  of  Fortran 
and  statistics.  Description  of  the  programs  versitility 
and  input  instructions  are  beyond  the  scope  of  this  report. 
However,  it  is  noted  that  the  program  provides  three  types 
of  output,  namely: 
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a.  A display  of  all  input  data  and  output 
computations  for  each  sample.  Each  sample  is  limited 

to  125  data  points.  A maximum  of  50  samples  per  computer 
pass  was  provided. 

b.  A graphical  display  for  each  sample 
containing  the  input  data,  the  computed  curve  and  the 
breakeven  line. 

c.  A summary  total  display  which  accumulates 
and  totals  the  pertinent  status  data  and  forecasted 
results  for  all  samples  contained  in  the  computer  pass. 
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3.6  CONCLUSIONS 


The  report  shows  that  the  constrained  regression  method 
applied  to  an  exponential  relationship  offers  the  forecaster 
an  improved  method  of  final  cost  forecasting  and  introduces 
the  use  of  measured  subjectivity  as  a management  input. 

The  maximum  potential  of  this  procedure  requires  that  the 
CPR  data  from  many  historical  programs  be  collected,  and 
b-j's  and  b£ ' s processed  and  made  available  to  users  in 
program  offices. 

Small  and  large  program  offices  may  apply  this  procedure 
for  developing  long  range  forecasts  and  take  advantage  of 
local  computer  facilities.  In  small  offices  with  limited 
resources,  this  procedure  may  serve  as  one  of  the  few 
methods  that  may  be  available  for  developing  forecasts. 

In  large  offices,  it  may  serve  as  one  of  many  independent 
forecasting  methods  for  comparative  analysis. 

It  is  believed  that  the  constrained  method  can  be 
improved  by  the  acquisition  and  testing  of  additional  CPR 
data  from  all  types  of  Department  of  Defense  programs.  For 
example,  it  may  be  possible  to  generate  confidence  limits 
with  each  forecast  if  a large  volume  of  historical  data 
is  available.  If  the  procedure  warrants  further  sophistication, 
program  simulation  techniques  could  be  examined  and  applied. 
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Other  factors  such  as  schedule  variance  could  be 
considered  and  tested  for  their  impact  on  the  final 
forecast.  Different  growth  relationships  and  their 
constraining  procedures  could  be  tested  if  the  added 
complexity  is  justified.  In  addition,  the  use  of  different 
relationships  could  be  tested  at  discrete  milestones  or 
phases  of  historical  programs  for  application  on  ongoing 
programs . 
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ACWP(Y)  *10 

.00  20.00  40.00  60. 0C  80.00  100. CO  120.00  140.00  160.00 


SAMPLE  COMPUTER  OUTPUT 


COST  PERFORMANCE  FORECASTING  MOOEL-C/SCSC 

(Company  name)  ROTE 

TOTAL  SYSTEM  LEVEL:  l TOTAL  COS T ( 000 1LES5  OR. PROFIT 

GATE: 

FUNCTION:  F=Btl) »X( l . 1) ««B(  2 ) 

CONST.  PARIS):  NONE 
PARAMETER! S 1 : 0. 2909  1.1175 

PERCENT  COMPLETION:  100.00 

SAMPLE  SIZ£:N=  60 
7.  FINAL  VARIANCE^  13.19 


^3.00 


RCTURL6=  © 

EST IMRTCO'  A 
8RERK-EVEH~UHC=  X 
rORCLRSTCO  PO tMT5=  * 


n r 

20.00  40.00  60.00  80.00 

OBSERVED  BCWP(X) 


100.00 

*103 


120.00 


140.00 


160.00 


FIGURE  2 
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